Multi-scale tensor network architecture for machine learning
نویسندگان
چکیده
Abstract We present an algorithm for supervised learning using tensor networks, employing a step of data pre-processing by coarse-graining through sequence wavelet transformations. These transformations are represented as set network layers identical to those in multi-scale entanglement renormalization ansatz network. perform and regression tasks model based on matrix product states (MPSs) acting the coarse-grained data. Because entire consists contractions (apart from initial non-linear feature map), we can adaptively fine-grain optimized MPS ‘backwards’ with essentially no loss performance. The itself is trained adaptive density group algorithm. test our methods performing classification task audio temperature time-series data, studying dependence training accuracy number showing how fine-graining may be used initialize models which access finer-scale features.
منابع مشابه
Multi-resolution Tensor Learning for Large-Scale Spatial Data
High-dimensional tensor models are notoriously computationally expensive to train. We present a meta-learning algorithm, MRTL, that can significantly speed up the process for spatial tensor models. MRTL leverages the property that spatial data can be viewed at multiple resolutions, which are related by coarsening and finegraining from one resolution to another. Using this property, MRTL learns ...
متن کاملAn Adaptive Sensor Network Architecture for Multi-scale Communication
Sensor networking has emerged as a promising tool for monitoring and actuating the devices of the physical world, employing self-organizing networks of battery-powered wireless sensors that can sense, process, and communicate. Such networks can be rapidly deployed at low cost, enabling large-scale, on-demand monitoring and tracking over a wide area. Energy is the most crucial and scarce resourc...
متن کاملAn Adaptive Scheduling Protocol for Multi-scale Sensor Network Architecture
In self-organizing networks of battery-powered wireless sensors that can sense, process, and communicate, energy is the most crucial and scarce resource. However, since sensor network applications generally exhibit specific limited behaviors, there is both a need and an opportunity for adapting the network architecture to match the application in order to optimize resource utilization. Many app...
متن کاملLearning Relevant Features of Data with Multi-scale Tensor Networks
Inspired by coarse-graining approaches used in physics, we show how similar algorithms can be adapted for data. The resulting algorithms are based on layered tree tensor networks and scale linearly with both the dimension of the input and the training set size. Computing most of the layers with an unsupervised algorithm, then optimizing just the top layer for supervised classification of the MN...
متن کاملUnifying Multi-domain Multitask Learning: Tensor and Neural Network Perspectives
Multi-domain learning aims to benefit from simultaneously learning across several different but related domains. In this chapter, we propose a single framework that unifies multi-domain learning (MDL) and the related but better studied area of multi-task learning (MTL). By exploiting the concept of a semantic descriptor we show how our framework encompasses various classic and recent MDL/MTL al...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Machine learning: science and technology
سال: 2021
ISSN: ['2632-2153']
DOI: https://doi.org/10.1088/2632-2153/abffe8